Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback 
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We extend the framework of forward and reverse processes commonly utilized in the derivation and 
analysis of the nonequilibrium work relations to thermodynamic processes with repeated discrete 
feedback. Within this framework, we derive a generalization of the detailed fluctuation theorem, 
which is modified by the addition of a term that quantifies the change in uncertainty about the 
microscopic state of the system upon making measurements of physical observables during feed- 
back. As an application, we extend two nonequilibrium work relations: the nonequilibrium work 
fluctuation theorem and the relative-entropy work relation. 
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I. INTRODUCTION 

The nonequilibrium work relations are a family of pre- 
dictions concerning the fluctuations in the work per- 
formed on a microscopic system driven far from equi- 
librium [3-Q- They have been important for the study 
of fundamental issues in the thermodynamics of small 
systems and have proven to be powerful tools for calcu- 
lating equilibrium free energy differences from nonequil- 
brium processes, both in experiments jij-flll] as well as in 
computer simulations 

At the heart of the nonequilibrium work relations 
is a statement about the timc-reverseal symmetry of 
the microscopic dynamics termed the detailed fluctua- 
tion theorem |13T - fl9| (also called microscopic reversibil- 
ity l3| or the generalized fluctuation-dissipation theorem 
QL HO, HII ) • The detailed fluctuation theorem relates the 
probability to observe microscopic trajectories of the sys- 
tem through phase space during two thermodynamic pro- 
cesses related by time-reversal: the forward process and 
the reverse process. This framework of forward and re- 
verse processes has been beneficial for investigating the 
role of irreversibility at the microscopic scale Q . 

However, the nonequilibrium work relations and the 
detailed fluctuation theorem are not applicable to sys- 
tems manipulated using feedback - a procedure in which 
microscopic information about a system is utilized to ma- 
nipulate or control its evolution. Given the frequency 
with which feedback occurs in physics, biology, and en- 
gineering [22j |. it is important to extend the work fluc- 
tuation relations to include feedback. This will clarify 
the thermodynamics of feedback [23l426|l as well as the 
the thermodynamics of computation [27H29| . and possi- 
bly elucidate the role of information processing in control 
theory [HHI]. 

Feedback can be implemented discretely through a se- 
ries of feedback loops initiated at a sequence of prede- 
termined times or continuously at every instant of time. 
Initial investigations into the work fluctuation relations 
in the presence of continuous feedback were made by 
Kim and Qian in the context of molecular refrigerators 



driven by velocity-depenedent feedback control [32] . The 
first work relation extended to include discrete feedback 
was the nonequilibrium work fluctuation theorem Q , re- 
cently reported by Sagawa and Ueda |33j . They demon- 
strated that when a system is manipulated using one 
feedback loop the nonequilibrium work fluctuation theo- 
rem is modified by the addition of a term that accounts 
for the microscopic information gained during feedback. 
In this article, we develop a framework of forward and 
reverse processes for repeated discrete feedback in order 
to analyze and extend Sagawa and Ueda's result. More- 
over, we generalize the detailed fluctuation theorem to 
include repeated discrete feedback. We find that the in- 
formation gained during feedback must be incorporated 
into the work relations. As an application, we extend 
the nonequilibrium work fluctuation theorem 0, |33| as 
well as the relative-entropy work relation 0, H[ in the 
presence of repeated feedback. (While this article was 
under consideration, similar results were published [34j . 
We postpone a discussion comparing Ref. [34| with the 
present work until the conclusion.) 

Our central result (Eq. [1] below) can be summarized 
as follows. Consider a classical thermodynamic system 
initially in equilibrium at inverse temperature /?. Imag- 
ine driving this system away from equilibrium from time 
t = to r by implementing a series of feedback loops at 
N predetermined times tf., k = 1, . . . , N. At each tk, a 
physical observable Mk is measured. Based on the out- 
come of this measurement we drive the system by vary- 
ing a set of external parameters A with time. In each 
repetition or realization of this entire process, which we 
call the forward process, the system will trace out a dif- 
ferent microscopic trajectory 7 Tj o through phase space. 
Furthermore, the protocol A t used to vary the external 
parameters A will differ in each realization due to fluc- 
tuations in the measurement process. We are interested 
in comparing the statistics of 7 Tj o and A t in the forward 
process to those of the time-reversed conjugate pairs j T , 
and A t in the time-reversed process, which we call the 
reverse process. There is no feedback in the reverse pro- 
cess (no measurements are made). Instead an ensemble 
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of realizations of the reverse process is generated by exe- 
cuting each external parameter protocol observed in the 
forward process in reverse. Our main result is that the 
ratio of the probability to observe 7 T .o and At in the 
forward process V[j T ,o', -^-t] to the probability to observe 
j T: o and Af in the reverse process Ppy^At] satisfies a 
detailed fluctuation theorem for discrete feedback 



P[7r,o;A f ] 

%r,o;A t ] 



(1) 



where Wa is the dissipated work. The new quantity ap- 
pearing in Eq. [TJ /, quantifies the change in our uncer- 
tainly about the microscopic state of the system upon 
measuring the physical observables Mi , Mi , . . . , Mjv in 
each realization. The avereage of / over many realiza- 
tions (/} is the mutual information [3(3], which is an in- 
formation theoretic measure of the reduction in our un- 
certainity about the microscopic state of the system upon 
making measurements. Moreover, (/) naturally appears 
in the thermodynamics of feedback developed by Cao and 
Feito [26[ , where (/) is equal to the reduction in the Shan- 
non entropy of a thermodynamic system under feedback 
control [see Eq. (7) of Ref. |||]. 

Our analysis begins in Sec. [IT] by motivating the defini- 
tions of the forward and reverse process using the Szilard 
engine as a pedagogical example. Our main result (Eq.Q} 
is then derived in Sec. IIIII In Sec. IIV1 the interpretation 
of / is developed in detail using ideas from Bayesian infer- 
ence. EquationUJis then exploited in Sec.[V]to generalize 
two work fluctuation relations, the nonequilibrium work 
fluctuation theorem 0, [33[ and the relative-entropy work 
relation [1, Q. Finally, we conclude in Sec. IVII with an 
outlook towards future research directions. 



II. MOTIVATION AND DEFINITIONS 

Before deriving Eq. [TJ it is instructive to first motivate 
and establish the definitions of the forward and reverse 
processes in the context of the Szilard engine [35| . de- 
picted in Fig. [TJ This will generalize the usual notions of 
forward and reverse processes common in the study of the 
work relations [3, 4]. The Szilard engine is composed of a 
single ideal gas particle in a box of volume V in thermal 
contact with a heat bath at inverse temperature (3. We 
begin by describing the forward process, which is illus- 
trated in Fig. [JJ by the sequence of snapshots proceeding 
from top to bottom. Initially, the engine is allowed to 
relax to equilibrium. A partition is then inserted in the 
center of the box, isolating the particle in either the left 
or right half of the box. Feedback begins by measuring 
in which half of the box the particle is located. The po- 
sition of the partition is then shifted in a manner that 
depends on the measurement outcome: if the particle is 
found in the left (right) half of the box, the partition is 
slide all the way to the right (left). Finally, the partition 
is removed and the particle is allowed to relax back to 
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FIG. 1. Illustration of a realization of the forward and the 
reverse processes for the Szilard engine in which the particle 
is measured to be in the left half of the box. The forward 
process is depicted by the sequence of illustrations running 
from top to bottom. The reverse process is the time-reversed 
forward process; as such, time flows from bottom to top. 



equilibrium. Imagine repeating this process a number of 
times. Each time equilibrating the particle, implement- 
ing the feedback loop, and finally allowing the engine to 
relax back to equilibrium. This generates an ensemble of 
realizations of the forward process. 

Within the framework of the work relations, the reverse 
process is implemented by carrying out each step (or each 
macroscopic control action) of the forward process in the 
reverse order. For feedback processes the external pa- 
rameter protocols are implemented in response to the 
outcomes of measurements. The naive time-reversal of 
this procedure - implementing a protocol and then mak- 
ing the measurement used to determine this protocol - 
would be acausal, because we would have to implement 
protocols in response to measurements made after the 
protocol was executed. Instead, we generate an ensem- 
ble of realizations of the reverse process by first generat- 
ing an ensemble of realizations of the forward process and 
then implementing the reverse of each protocol which was 
observed in the forward process. For example, suppose 
we observe a realization of the Szilard engine in which 
the particle was found in the left half of the box and the 
partition was moved to the right. Having observed this 
realization of the forward process, we generate a realiza- 
tion of the reverse process by actuating each action of the 
forward process in reverse, which is depicted in Fig. [TJby 
reading the images from bottom to top. The particle is 
first equilibrated at inverse temperature (3. The partition 
is then inserted on the right side of the box and then slide 
to the center. Finally, the partition is removed and the 
engine is allowed to relax back to equilibrium. Repeat- 
ing this process a number of times, each time reversing 
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an observed realization of the forward process generates 
an ensemble of realizations of the reverse process. 

Observe that in the reverse process no measurements 
are performed. Instead, in an ensemble of realizations of 
the reverse process the protocols are implemented ran- 
domly according to the distribution in which they occur 
in the forward process. The reverse process cannot be 
executed independently of the forward process; one must 
first perform the forward process. This reliance of the 
reverse process on the forward process is a consequence 
of the time-reversal asymmetry of feedback and is an es- 
sential difference between thermodynamic processes with 
and without feedback. 



III. DERIVATION 

We are now in a position to derive Eq. [1] Let us begin 
by fixing notation. Consider a classcial system, whose 
position in phase space (or microscopic configuration) is 
z = (x, p), where x denotes the system's coordinates 
and p denotes its momentum. The energy of the system 
E(z, A) is parameterized by a vector of controllable ex- 
ternal parameters A and is assumed to be time-reversal 
invariant for each fixed A, E(z, A) = E(z*,X), where 
z* = (x, — p). The dynamics are assumed to be Marko- 
vian dynamics (which includes deterministic dynamics) 
that preserve the canonical equilibrium distribution for 
each fixed A 



P e9 (z|A) 



B P[F(\)-E(z,\)] 



(2) 



where F(X) is the free energy. The position of the system 
at time t will be denoted as z t . The collection of phase 
space points visited by the system during the course of 
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its evolution from t — r to s will be termed a microscopic 
trajectory and will be labeled 7sjr = {z t }f =r . 

The forward process is defined as the following se- 
quence of events. The system is initially equilibrated with 
a thermal reservoir at inverse temperature /3 with the 
external parameters fixed at A — Aq. Consequently, the 
initial statistical state of the system is P eq (z\Ao) (Eq.[5]). 
From t = to ti the system is driven away from equi- 
librium by varying A with time using a predetermined 
initial protocol A°, from Ag = A to A£ = -Bo- Then 
at subsequent times tk, k = 1, . . . , N, feedback loops are 
implemented. At each tk a physical observable Mk is 
measured with (possibly continuous) outcomes m&. Each 
measurement outcome m,k occurs with a probability that 
depends on the phase space position of the system at 
the time of measurement, P/ £ (m/ c |z tfc ), and is indepen- 
dent of the previous measurements. We collect all the 
measurement outcomes up to and including time tk into 
a vector fik = {mi, . . . , m^}, which we call the the mea- 
surement trajectory up to tk- During each time interval 
from t = tk to tk+i {tN+i = t) the external parame- 
ters are varied using a protocol which depends on the 
outcomes of all measurements up to tk, X k (fj,k), from 
A£> fc ) = A k (fi k ) to \ h tk+ M) = Addition- 
ally, we assume that each fik is associated to a unique 
protocol [i.e. X k (fik) -^t (a4) f° r au Mfe ^ an d that 
A k (nk) = B k ~ 1 (/ifc_i) , to ensure that the protocol is con- 
tinuous at each measurement time tk- The microscopic 
trajectory jt k+1 .t k taken by the system during this time 
interval occurs with probability P V)t k+X ,t h \zk, ^t{^k)\, 
which is conditioned only on the position of the system 
at time tk, zt k - since the dynamics are Markovian - 
and depends on the protocol executed \ k (/ifc). The com- 
plete protocol executed from t = to t, we represent by 
collecting the individual protocols used in each feedback 
loop into a vector, A t (/Ltjv) = {A° , . . . , \^{^n)}- The 
probability to observe a realization of the entire forward 
process with trajectory 7 T) o and protocol A t (/ZAr) is 



V [ 7t , ; A t ] = P [7r,t N h N , Af (fx N )] P N (m N \z tN ) - P [ lt2M \z tl ,\]{^)\ P^m^P [ 7tl ,ok, A°] P eq {z \A ). (3) 
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The work done on the system along this trajectory is 



N 

W[ lTfi ;A t }^J2 wk ^ + ^ X t(^ 

k=Q 

JL rth+i f) 
k=o Jt * OA 



(4) 



the heat flow into the system is 

N 

Q[ 7T ,o;A t ]-^Q fc [ 7ffc+1 , tfc ;A t fc ( Mfc )] 

fc=0 
N rt h+ i 



22 J dsz s —E[z s ,X k ^ k )] , 



(5) 



k=0 Jtk 



and the change in energy satisfies the first law of ther- 
modynamics 



AE[ lT . ; A t ] = E[z T , B (ji N )] - E{z ,A ) 
= Wl7r,o;At] + Q[7 T , ;A t ], 



(6) 
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where t = and Aj(^o) = A". Since the protocols de- 
pend on the measurement outcomes the free energy dif- 
ference is realization dependent, 



AF[A t ] = F [A^(/xjv)] — F [A°] 
= F[S A, ( / , Ar )]-F(A ). 

Likewise, the dissipated work is 

w d [ 7T , ; A t ] = W[ 7r , ; - AF l A * 



(7) 



(8) 



As discussed in Sec. HI1 we generate an ensemble of 
realizations of the reverse process by carrying out each 
observed realization of the forward process backwards 
in time. Take for example the time-reversal of a real- 
ization of the forward process with protocol A t (/xjv) = 
{A°, . . . , A^(^jv)}- The system is first equilibrated at in- 
verse temperature /3 with external parameters fixed at 
A^ (jjln) = B (/ijv)j so that the initial statistical state 
of the reverse process is P e « [z\B N (n N )] (Eq.EJ. Then 
from time t — to r the external parameters are var- 
ied according to the time-reversed individual protocols 
executed in the reverse order: for each time interval 
t = t — tk+\ to r — tk, k = 0, . . . , N, the external parame- 
ters are varied according to the reverse individual proto- 
col X^ k (fik) — ^T-t(Mfe)- The reverse complete protocol 
A t = A r _ t is A t (/xjv) = {A°(^jv), . . . , A^}. Observe that 
in an ensemble of realizations of the reverse process the 
probability to observe reverse complete protocol A t (fiN), 
7r[A((/ijv)], is independent of the microscopic trajectory 
and is equal to the probability that the conjugate for- 
ward complete protocol A((/xjv) = A r _ t (/ijv) occurs in 
the forward process, 7r[Af (/x/v)]: 



7T[A t 



djr.o'Phr^At} 



(9) 



where d 7r! o is a measure on the space of microscopic tra- 
jectories. Moreover, due to the assumed one-to-one cor- 
respondence between measurement trajectories and pro- 
tocols, the probability distribution 7r[A((/xjv)] is equal to 
the probability distribution of measurement trajectories 
in the forward process 

Pn(hn) = Pjv(mjvlMJV-i) • • • P2(m 2 \^i)Pi(m 1 ), (10) 



where Pk{mk\^k-i) is the conditional probability to ob- 
serve measurement outcome mj. in the forward process 
conditioned on the measurement trajectory fik-i, and 
the equality follows from the product rule of conditional 
probabilities (36[. Combining Eqs. l9l and ITUl the proba- 
bility to implement reverse complete protocol At in the 
reverse process is 

n[A t (n N )} = P N (^ N ). (11) 

For every trajectory from time t = s to r, 7r jS — 
{ z t} r t=s there is a conjugate reverse trajectory 7 r _ s r _ r = 
{ztY t Zr-r = {zt}t=r: where z t = (see Fig. [2}. The 




FIG. 2. Illustration of the forward trajectory 7tj o and reverse 
trajectory 7 T ,o with two feedback loops implemented at times 
ti and ti. 



probability to observe reverse trajectory 7 Tj o and reverse 
complete protocol A t in the reverse process is 



V 7 T , ;A t = P[7 Ti0 |A t ]7f[A t ], 



(12) 



where P[ 7Ti o|At] is the conditional probability to observe 
7 Tj o conditioned on executing protocol A t . Substituting 
in Eqs. [TU] and [TTJ and expanding P[ 7T: o|At] in condi- 
tional probabilities using the product rule of conditional 
probabilities [11], allows us to express V as 



7 r , ; At = P[7r,r- 



Af]P[7 T _ tl , T _ t j5 r _i 2 ,Af- 1 ( m )]P 1 ( Ml )...P[ 7T _ tN:0 |z ,A°(/i W )]P w (m J v|/i J v_ 1 )P e « [S \B N (p N )] . 

(13) 



The structure of Eq. [T2l (Eq. IT3)) suggests an alternative 
method for implementing the reverse process. We ran- 
domly select a reverse protocol A t (/x/v) according to the 
distribution 7f[A t (/xjv)] fEq. lTTI) . Next, we equilibrate the 
system at inverse temperature /3 with external parame- 
ters fixed at Aq(//jv') = B n (/in), drive the system away 



from equilibrium according to At(/ijv), and finally allow 
the system relax back to equilibrium at inverse temper- 
ature j3 with external parameters fixed at A r (/ijv) = A a . 



With this setup, we can now derive Eq. Q] as a conse- 
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quence of the detailed fluctuation theorem [l], ID, [H, [T^-fUl 



P [lt k+1 ,t k \z tkl \t(Pk)] 



,-0Q k ht k 



jT-tk,T-t k+1 \z T -t h+1 ,\ (Pk) 



sA?(«0] 



(14) 



where Q fc is defined in Eq. [5] Equation [14] has been de- 
rived for a wide class of dynamics and is a consequence of 
the time-reversal symmetry of the microscopic dynamics 
- the energy is time-reversal invariant (see the discussion 
proceeding Eq. [2]). 

To derive Eq. [TJ we take the ratio of Eqs. [3J and [TJJ 
then substitute in Eqs. [21 El [H El [TJ] and the definition 
of the change of uncertainty 

rr aii \ p N(m N \z tN ) . . .P2(m 2 \z t2 )P 1 (m 1 \z ti y 

P[1t,o; At = In -5-7 i x Bl i — T 

L P N {m N \iL N -i) . . .P2{m2\^i)Pi{mx) 

which, after a short manipulation, leads to Eq. [JJ 
reprinted here for convenience, 

P[7r,o;A t ] 



/3V^bv,o;A t ]+J[7T,o;A t ] 



(16) 



P[7-r,o;A t ] 

Equation [T5] (Eq. [TJ) is an extension of the detailed fluc- 
tuation theorem (Eq. I14[) for systems driven away from 
equilibrium by repeated discrete feedback. However, 
there is a fundamental difference between Eqs. [Jj)] and 
1141 due to the inherent time-reversal asymmetry of feed- 
back. Since no measurements are made in the reverse 
process, there are microscopic trajectories and reverse 
complete protocols whose time-reversed conjugates do 
not occur together in the forward process; that is, there 
exists a 7 Ti o with conjugate reverse trajectory 7 T ,o, and 
A t = A T _ t , such that P[-f T ,a;M = and P[ 7t , ; A t ] ^ 0. 
Consequently, the ratio P/P, appearing in Eq. [H)l is 
well-defined, but the reciprocal P/P is not well-defined - 
mathematically, we say P is absolutely continuous with 
respect to V (V <C P) [37|, however the reverse is not 
true. For example, consider a Hamiltonian system in 
which we implement feedback by making an error-free 
measurement at t = of whether the system is in a re- 
gion of phase space 5. If the system is found in 8, we drive 
the system with external parameter protocol Xf . The re- 
gion of phase space 8 then evolves deterministically to 
the region of phase space 5', as illustrated in Fig. [3j In 
the reverse process the initial system state is sampled 
from a canonical distribution over all phase space. Con- 
sequently, when the protocol Xf is executed, the system 
may evolve along a trajectory T — the conjugate trajec- 
tory of T depicted in Fig. [31 which begins outside of 5 
and terminates outside of 8'. Clearly, the conjugate tra- 
jectory r can never be observed in the forward process 
simultaneously with Xf; V[T; Xf] = while P[f ; X s t ] ^ 0. 



IV. INTERPRETATION OF I 

We have mentioned that / (Eq. [To]) quantifies a change 
in uncertainty about the microscopic state of the sys- 




FIG. 3. Illustration of the tube of trajectories of the forward 
process evolving from phase space region 8 and to region 8' 
under Hamiltonian dynamics driven by external parameter 
protocol A* associated to measuring the initial state of the 
system inside region 8. T, the conjugate trajectory of F, ex- 
emplifies a trajectory of the reverse process whose conjugate 
trajectory T cannot be realized in the forward process simulta- 
neously with \f , since F begins outside of phase space region 
8. 



tern upon making measurements. We now provide an 
argument supporting that assertion using methods of 
Bayesian inference. Our analysis begins by using Bayes's 
theorem [36j to rewrite Eq. [15] in terms of the condi- 
tional probability distributions p(zt k \[ik) to find the sys- 
tem at Zt k conditioned on the sequence of measurement 
outcomes in 



AT 



I[jt,o; AtOujv)] = X! ln 



fe=i 



P(zt k \Hk) 



p(z tk \fik-l) 



(17) 



To interpret Eq. 1171 recall that probability distributions 
measure the degree of belief a rational person has in 
the truth of a proposition, i.e. they quantify our uncer- 
tainty (36j. For example, as rational statistical physicists, 
our uncertainty in the state of our system at time t\, just 
prior to the first measurement, is 

Pitti) = J 1 dry tu o P bt u o\zo, X° t ] P eq (z Q \A ). (18) 

Upon making a measurement, we gain information al- 
tering our beliefs and forcing us to update (or change) 
the probability distribution describing our state of knowl- 
edge about the system. For example, suppose at time t± 
we measured Mi and obtained outcome mi. We have 
gained some information and as rational beings we must 
update our uncertainty p(z tl ). Bayesian inference tells 
us that the new probability distribution describing our 
uncertainty - the posterior probability distribution - is 
obtained from Bayes' theorem and is simply p(zt 1 \mi), 
the conditional probability for the system to be at z tl 
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given that the outcome of the measurement was m\ [361 ) . 
Comparing with Eq. 1171 we see that the k = 1 term in 
the sum is In [p(zt 1 \mi)/p(zt 1 )], the log of the ratio of 
the probability distributions before and after the mea- 
surement; hence, it is a measure of how our uncertainty 
changes upon making a measurement. Repeating this 
argument, we find that each term in the sum in Eq. [T7] 
represents a change in our uncertainty upon making each 
new measurement. Notice that I can be positive or nega- 
tive in any given realization, our uncertainty can decrease 
or increase. However, the average of I over many realiza- 
tions (/) is always positive [30| , reflecting that on average 
gaining information lowers our uncertainty. 



V. APPLICATIONS 

Equation [1] immediately leads to two work relations 
fEqs. HI?! and I2U1 below). It is a straightforward exercise 
using Eq. [T] to show that 



-PWd-I 



(19) 



where the angle brackets denote an average of an ensem- 
ble of realizations of the forward process. Equation [T9l is 
a generalization of the nonequilibrium work fluctuation 
relation of Sagawa and Ueda [HI for multiple feedback 
loops. Similarly, Eq. [T] implies a generalization of the 
relative-entropy work fluctuation relation [3, H| : 



D[P\\P] = 0(W d ) + (I), 



(20) 



where D(f\\g) = f dx f(x)\n[f(x)/g(x)} is the relative 
entropy, an information theoretic measure of the distin- 
guishability of two probability distributions (30j . 

Furthermore, applying Jensen's inequality [3(| to 
Eq. [I9l o r exploiting the positivity of the relative en- 
tropy [30J in Eq. [20l one finds that 



P(W d ) + (I) > 0, 



(21) 



which can been viewed as a generalization of the second 
law of the thermodynamics in the presence of feedback 
331. 



VI. CONCLUSION 



conclusion that analyzing feedback using the framework 
of forward and reverse processes developed here may be 
beneficial to understanding the thermodynamics of feed- 
back. 

Exploiting Eq. [T] we generalized the detailed fluctu- 
ation theorem (Eq. [T]), the nonequilibrium work fluctu- 
ation theorem (Eq. 1191) . and the relative-entropy work 
relation (Eq. I20[) to systems manipulated by repeated 
feedback. 

The next step in understanding the thermodynamics 
of feedback is to incorporate feedback into the fluctua- 
tion relations EMI I381 - I40T ] which are predictions about 
the fluctuations of thermodynamic quantities in far from 
equilibrium systems. A first step in this regard has al- 
ready been taken by Kim and Qian [32j . who have ana- 
lyzed the fluctuation relations in the presence of velocity- 
dependent feedback control. 

While this article was under consideration, another pa- 
per proposing a detailed fluctuation theorem in the pres- 
ence of feedback was published [13] . Although the results 
are similar, our analysis contains a number of additional, 
important elements not found in Ref. [34j . Our central 
result (Eq. [1]) applies to processes with multiple feedback 
loops, while Ref. [34j considers only a single loop. We also 
provide a detailed physical interpretation of the reverse 
process, including a description of the procedure for ex- 
ecuting that process, and a discussion of the asymmetry 
between the forward and reverse processes. Finally, we 
give a physical interpretation for the change of uncer- 
tainty along a microscopic trajectory. 

Moreover, we believe the main conclusions [Eqs. (11) 
and (13)] of Ref. [13] suffer from physical inconsistencies. 
While Eq. (11) of Ref. [13] assumes that feedback is im- 
plemented in both the forward and reverse processes, the 
protocol employed in the reverse process is acausal: it 
is executed in response to a measurement made in the 
future [cf. Eq. (8) of Ref. [34j]. Reference [13] also inves- 
tigates forward and reverse processes identical to those 



discussed in the present paper. In this context Ref. [34 1 
proposes a Crooks-type fluctuation relation for the joint 
distribution of dissipated work and change in uncertainty, 
p(Wd, I). This result is problematic: the change of un- 
certainty in the reverse process is ill-defined, since no 
measurements are made in the reverse process |4lj . 



For systems driven by repeated discrete feedback, we 
have introduced a framework of forward and reverse pro- 
cesses. We defined a reverse process in which the steps of 
the forward process are carried out backwards in time. As 
a consequence, we found that the change in uncertainty 
/ (Eq. [15)) during each feedback loop must be incorpo- 
rated when analyzing the thermodynamics of feedback. / 
is a natural generalization to repeated discrete feedback 
of the information measure utilized by Sagawa and Ueda 
in Ref. [Hj]. Cao and Feito have also observed that the 
ensemble average {/) naturally occurs in their thermody- 
namics of feedback [26[. These observations support the 
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